Listing of Claims: 



1 . (Currently Amended) A computer implemented method of detecting an imminent collision 
comprising the steps of: 

capturing and preprocessing imagery of a scene proximate a platform using an imaging 

device ; 

producing from the imagery a depth map using a depth map generator, wherein each 
pixel in the depth map has associated 3D position data; 

performing at a collision detector the steps of tessellating the depth map into a number of 
patches and selecting a plurality of the patches of the depth map for processing, wherein said 
processing comprise classifying the selected plurality of patches of the depth map into a plurality 
of classes based on said 3D position data ; 

detecting a potential threat in the tessellated depth map during the processing of the 
selected plurality of the patches; 

estimating the size of the detected potential threat; 

estimating the position of the detected potential threat; 

estimating the velocity of the detected potential threat ; 

performing a trajectory analysis of the detected potential threat using the estimated 
position and the estimated velocity; and 

performing a collision prediction based on the trajectory analysis. 

2. (Original) The method of claim 1, further including determining if a collision is imminent 
based on the collision prediction and on the estimated size of the potential threat. 

3. (Original) The method of claim 1, further including filtering the estimated position and 
filtering the estimated velocity before performing trajectory analysis. 

4. (Previously Presented) The method of claim 3 wherein the filtering includes Kalman 
filtering. 
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5. (Original) The method of claim 1 wherein estimating the velocity of the detected potential 
threat includes the step of identifying 2-dimensional feature correspondences from imagery 
produced in different time frames. 

6. (Previously Presented) The method of claim 5 wherein estimating the velocity of the detected 
potential threat further includes the step of obtaining 3D correspondences from the 2- 
dimensional feature correspondences and from the depth map. 

7. (Original) The method of claim 6 wherein estimating the velocity of the detected potential 
threat further includes the step of estimating velocity using Random Sample Consensus. 

8. (Currently Amended) The method of claim 1 wherein said processing the selected plurality 
of patches further comprises: 

fitting a plane to each patch of said selected plurality of the patches; 
obtaining a normal vector to each plane, 

said plurality of classes comprise one class representing the patches that are likely to 
represent a potential threat, another class representing the patches that possibly represent a 
potential threat, and another class representing the patches that are unlikely to represent a 
potential threat, wherein said classifying is based on the obtained normal vector for each patch 
and on 3D pooitions of each patch . 

9. (Original) The method of claim 8 further including the step of grouping patches that are 
likely to represent a potential threat together. 

10. (Original) The method of claim 9 further including the step of creating a bounding box that 
represents a potential threat, wherein the bounding box is created in accord with the grouping of 
patches. 

11. (Currently Amended) The method of claim 8 wherein detecting a potential threat in the 
tessellated depth map includes the steps of moving each patch after local tessellation to find the 
region of maximum stereo depth map data density near the original patch location, of discarding 
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a patch if the region of maximum st e r e o depth map data density does not meet a predetermined 
criterion, and adding the patch to the plurality of the patches if the patch density meets the 
predetermined criterion. 

12. (Original) The method of claim 8 wherein obtaining a normal vector includes the steps of 
calculating the third Eigen-vector of a matrix of patch values using a singular valued 
decomposition of the matrix, and then estimating the normal vector as the third Eigen-vector. 

13. (Currently Amended) A collision detection system, comprising: 

a st e r e o cam e ra pair an imaging device for providing imagery of a scene proximate a 
platform; 

a ster e o an image preprocessor for preprocessing said imagery; 

a depth map generator for producing a depth map from said preprocessed imagery! 
wherein each pixel in the depth map has associated 3D position data ; and 

a collision detector for tessellating the depth map into a number of patches, selecting a 
plurality of the patches of the depth map for processing, wherein said processing comprise 
classifying the selected plurality of patches of the depth map into a plurality of classes based on 
said 3D position data ; detecting a potential threat in said tessellated depth map during the 
processing of the selected plurality of the patches, 

wherein said collision detector estimates size, position, and velocity of said detected 
potential threat; 

wherein said collision detector performs a trajectory analysis of said detected potential 

threat using said estimated position and said estimated velocity; 

wherein said collision detector predicts a collision based on said trajectory analysis; and 
wherein said collision detector determines if a collision is imminent based on said 

collision prediction and on said estimated size. 

14. (Original) The system of claim 13, wherein said collision detector includes a filter for 
filtering image noise and outliers from said estimated position and from said estimated velocity 
before performing trajectory analysis. 
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15. (Previously Presented) The system of claim 13 wherein said collision detector estimates 
said by identifying 2-dimensional feature correspondences from imagery produced in different 
time frames and then obtains 3D correspondences of said 2-dimensional feature correspondences 
using said depth map. 

16. (Currently Amended) The system of claim 13, further including a host vehicle, wherein said 
image preprocessor comprises a stereo image preprocessor and said imaging device comprises a 
stereo camera pair is mounted in fixed locations relative to said host vehicle . 

17. (Currently Amended) The system of claim 13 wherein said collision detector detects the 
potential threat in the tessellated depth map by: 

fitting a plane to the selected plurality of said patches; 
obtaining normal vectors to said selected plurality of patches, 

wherein said classifying is based on said normal vector for that patch and on 3D positio ns 
of oaoh patch , as likely to represent a potential threat, as possibly representing a potential threat, 
or as being unlikely to represent a potential threat; and 

grouping patches that are likely to represent a potential threat together; and forming a 
bounding box around said potential threat based on said patch groupings. 

18. (Previously Presented) The system of claim 17 wherein said collision detector searches each 
patch after tessellation to find a densest part of said patch, discards said patch if said patch 
density does not meet a predetermined criterion, and adds said patch to said plurality of patches 
if said patch density meets said predetermined criterion. 

19. (Original) The system of claim 17 wherein obtaining normal vectors includes the steps of 
calculating for each patch a third Eigen-vector of a matrix of patch values using a singular valued 
decomposition of said matrix, and then estimating said normal vector as said third Eigen-vector. 

20. (Currently Amended) A computer readable medium having stored thereon a plurality of 
instructions, the plurality of instruction including instructions which, when executed by a 
processor causes the processor to perform the steps comprising: 
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capturing and preprocessing an imagery of a scene proximate a platform; 

producing from the imagery a depth map , wherein each pixel in the depth map has 
associated 3D position data ; 

tessellating the depth map into a number of patches and selecting a plurality of the 
patches of the depth map for processing, wherein said processing comprise classifying the 
selected plurality of patches of the depth map into a plurality of classes based on said 3D 
position data ; 

detecting a potential threat in the tessellated depth map during the processing of the 
selected plurality of the patches; 

estimating the size of the detected potential threat; 
estimating the position of the detected potential threat; 
estimating the velocity of the detected potential threat; 

performing a trajectory analysis of the detected potential threat using the estimated 
position and the estimated velocity; and 

performing a collision prediction based on the trajectory analysis. 

21. (Original) The computer readable medium of claim 20 that further causes the processor to 
filter the estimated position and the estimated velocity before performing trajectory analysis. 

22. (Original) The computer readable medium of claim 20 that further causes the processor to 
determine the velocity by identifying 2-dimensional feature correspondences from imagery 
produced in different time frames. 

23. (Previously Presented) The computer readable medium of claim 22 that further causes the 
processor to determine velocity by obtaining 3D correspondences from the 2-dimensional feature 
correspondences and from the depth map. 

24. (Currently Amended) The computer readable medium of claim 20 that further causes the 
processor to detect the potential threat by the steps of: 

fitting a plane to each patch of the selected plurality of patches; 
obtaining a normal vector to each plane, 
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wherein said classifying is based on said normal vector for that patch and on 3D positions 
of each patch , as likely to represent a potential threat, as possibly representing a potential threat, 
or as being unlikely to represent a potential threat. 

25. (Original) The computer readable medium of claim 24 that further controls a computer to 
group patches together that are likely to represent said potential threat. 

26. (Original) The computer readable medium of claim 25 that further causes the processor to 
create a bounding box that represents the potential threat, wherein the bounding box is created in 
accord with the patch groupings. 

27. (Currently Amended) The computer readable medium of claim 20 that further causes the 
processor to detect a potential threat in said tessellated depth map by the steps of moving each 
patch after local tessellation to find the region of maximum stereo depth map data density near 
the original patch location, discarding said patch if the region of maximum stereo depth map data 
density does not meet a predetermined criterion, and adding said patch to said plurality of 
patches if said patch density meets said predetermined criterion. 

28. (Original) The computer readable medium of claim 20 that further causes the processor to 
obtain normal vectors by the steps of calculating for each patch a third Eigen-vector of a matrix 
of patch values using a singular valued decomposition of said matrix, and then estimating said 
normal vector as said third Eigen-vector. 
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